1. Introduction
2. What is Bayesian Theorem
Bayesian Theory is a statistical framework for dealing with uncertainty, based on probabilities and updating beliefs with new evidence.
3. What is Bayesian Rule
Bayes' Rule is a fundamental theorem in probability theory that updates probabilities based on new evidence, underpinning Bayesian inference.
5. Bayesian Theorem Example
Problem Statement
You are given information about a medical test for a rare disease. The disease occurs in 1% of the population. The test has a sensitivity of 90% (true positive rate) and a specificity of 95% (true negative rate).
Bayesian Theorem Calculation
Let's use the Bayesian Theorem to calculate the probability of having the disease given a positive test result.
Given:
P(Disease) = 0.01 (Prior Probability)
P(Positive Test Result | Disease) = 0.90 (Likelihood)
P(Positive Test Result | No Disease) = 0.05 (False Positive Rate)
Calculating False Negative Rate:
P(Negative Test Result | Disease) = 1 - P(Positive Test Result | Disease) = 0.10 (False Negative Rate)
Calculating Evidence:
P(Positive Test Result) = P(Positive Test Result | Disease) * P(Disease) + P(Positive Test Result | No Disease) * P(No Disease)
P(No Disease) = 1 - P(Disease)
P(Positive Test Result) = (0.90 * 0.01) + (0.05 * 0.99) ≈ 0.0585
Applying Bayesian Theorem:
P(Disease | Positive Test Result) = (P(Positive Test Result | Disease) * P(Disease)) / P(Positive Test Result)
P(Disease | Positive Test Result) = (0.90 * 0.01) / 0.0585 ≈ 0.1538
The probability of having the disease given a positive test result is approximately 0.1538 or about 15.38%.
Conclusion
Bayesian Theory and Bayes' Rule offer a robust framework for reasoning under uncertainty and updating our beliefs based on new evidence. By embracing Bayesian thinking, we can make more informed decisions, especially in situations where data is limited or noisy. Remember to leverage Bayes' Rule wisely in real-world scenarios, ensuring that prior knowledge and likelihood estimates are accurate and relevant to achieve optimal results.